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Abstract — Computer vision yields high level understanding 
by computers, one of the most important areas in recognition is 
object recognition which is the process of finding a specific 
object in an image or video sequence. In this paper we present an 
application that employs a part of object recognition, this 
application is able to distinguish between different kinds of 
fruits.The paper is intended to demonstrate the process by 
taking three fruit examples which can be further extended to 
greater number of fruit identification in an image.This 
application is based on color and size through comparing the 
fruit identified in image with predefined size of fruits for proper 
segregation of fruits.The paper can find immense use conveyor 
belt implementation for proper identification of size of fruit. 

Index Terms — Image Processing; Object Recognition, 
OpenCV, Python 


I. Introduction 

Object recognition is the process of finding a specific object 
in an image or video sequence. It has became an important 
application of image processing, and have attracted the 
attention of many programmers recently. The paper describes 
a brief process to identify fruits which can be implemented on 
conveyor belt autonomous sorting of fruit.Further it can be 
used for educational purpose to enhance learning, especially 
for small kids and Down syndrome patients, of fruits pattern 
recognition and fruits features classification based on the 
fruit recognition result.Further the paper It can be used as a 
fruit recognition system in grocery store to automate labeling 
and computing the price. Our implementation included five 
steps: 

(1) Learning process. 

(2) Capture an image. 

(3) Identify the fruit using color segmentation technique. 

(4) Compare the image of the fruit so identified using step (3) 
with the image used for categorisation. 

(5) Highlight the fruit so identified and thus send necessary 
data to the user. 

These steps is illustrated below and depicted in (Figure 
2).The rest of this paper is structured as follows: 

Section two: provide a background of previous work, 
Section Three : illustrates the methodology, 

Section Four : describes the implementation steps followed 
in this project, and finally, 

Section Five : summarizes the conclusion. 
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II. BACKGROUND 

Computer vision is considered study and application of 
methods which allows computers to examine and extract 
image contents or content of multidimensional data in 
general to facilitate solving a specific vision problem, such as 
pattern classification problem [2]. They add Recognition is 
considered one of the main six areas in computer-vision, 
which are sensing, preprocessing, segmentation, description, 
recognition, and interpretation. Heidemann (2005) has 
presented an approach to establish image categories 
automatically using histograms, colors and shape descriptors 
with an unsupervised learning method, Seng and Mirisaee 
(2009) adds that the most popular analysis techniques that 
have been used for both recognition and 
classifications of two dimensional (2D) fruit images are 
color-based and shape-based analysis methods but, different 
fruit images may have similar color and shape values. So, 
using color or shape features analysis methods are still not 
effective enough to identify and distinguish fruits 
images.Rocha et. al. (2010) says that recognizing different 
kinds of vegetables and fruits is a recurrent task in 
supermarkets, where the cashier must be able to point out not 
only the species of a particular fruit but also its variety which 
will determine its price. 

III. METHODOLEGY 

The proposed method can process, analyze and recognize 
fruits based on color. It is often useful to simplify a 
monochrome problem by improving contrast or separation . 
In addition, it is easier and faster in processing. Our 
methodology can be summarized in the learning and 
recognition sections. (Figure 1) is the general block diagram 
for the project, as illustrated below, the program takes 
different fruit/vegetable images for the learning 
purpose,calculate their histograms, then, capture an image 
for Unknown fruit/vegetable, calculate its histogram, 
compare between histogram of unknown fruit image and 
histograms of learnt fruit images using Chi-square Method to 
find best matching image.Figure 2: Fruit/vegetables 
recognition Block Diagram 

IV. IMPLEMENTATION STEPS 

A. Preprocessing of Image 

i. Input Images 

Input images for different fruits/vegetables, in our 
implementation, the application had learnt Apple,Orange, 
Blueberry. 


9 


www.erpublication.org 






Identification of Apple, orange and berry and segregation according to sizes in images using Image processing 

techniques 


ii. Applying Gaussian Blur 

In image processing, a Gaussian blur (also known as 
Gaussiansmoothing) is the result of blurring an image by a 
Gaussian function. 

Hi. Convert To HSV Model 

Convert images to HSV model, we converted images to HSV 
model; because it is the right choice for detecting objects, 
other color models are sensitive to illumination, and this 
complicating the task of detecting the fruit. In HSV model the 
value (V) component is still sensitive to illumination, but we 
skipped this component to avoid illumination effects. 
Arivazhagan et. al. (2010) indicate that the HSV 
representation is often selected for its invariant properties. 
The hue is invariant under the orientation of an object with 
respect to the illumination and camera direction and hence 
more suited for object retrieval. We use these equations to 
convert them: 

For S: 

S = Max -Min \ Min 

Where Max is the maximum value of (R, G, B) Images 
and Min the minimum value of (R, G, B) Images. 

For H: 

If Max = Min then H is undefined 

If Max = R and G > B then H= 60* (G-B)/ (Max-Min) 

If Max = R and G < B then H= 60* (G-B)/ (Max-Min) +360 
If Max = G then H= 60* (B-R)/ (Max-Min) + 120 
If Max = B then H= 60* (R-G)/ (Max-Min) + 240 

iv. Masking 

Image masking is a process of graphics software like 
Photoshop to hide some portions of an image and to reveal 
some portions. It is a non-destructive process of image 
editing. 

v. Opening and closing on masked image 

Opening is just another name of erosion followed by 
dilation. It is useful in removing noise.Closing is reverse of 
Opening, Dilation followed by Erosion. It is useful in 
closing small holes inside the foreground objects, or small 
black points on the object.This processes is required to 
remove the external noise from the image which are in the 
form of black or white 

Dots which can cause error in identification of fruits. 

A. Comparing contours 

The contour of the preprocessed image is used to calculate 
the area and then size of the thus identified fruit.The size 
comparison is then used for segregation according to size. 

B. Capture an image for the intended fruit to he 
recognized: 

After capturing the image, apply the following steps as in 
the learning process. 

Convert image to HSV model. 

To avoid the illumination effects we must convert the image 
to HSV model as in the learning process that mentioned 
previously. 

Find the Histogram of this image. 


Calculate the histogram of captured image in order to 
compare it with stored histograms of learnt images. 

C. Comparing between learnt images and captured 
image: 

Compare between the histogram of captured image and each 
of the histograms of learnt fruit images that we stored in the 
array of histograms using the Chi-square method [1], in 
general, Chi-square test is a test that uses the chi-square 
statistic to test the fit between a theoretical frequency 
distribution and a frequency distribution of observed data for 
which each observation may fall into one of several classes 
[5]. Chi-square method is considered a minimum distance 
classifier and can be expressed in the following equation; it 
gives the difference between two images. 

D chi-square (HI, H2) = £i ((HI (i)-H2 (i)) 2/ (HI (i) +H2 

(i))) 

where HI is the histogram of the learnt image, H2 is the 
histogram of captured image, it epresses the sum of squere 
diffrence between the value of histogram bins of learnt 
images and the value of histogram bins of captured 
image,divided by the sum of both values of histogram bins, in 
which a low difference between the histograms represents 
better match than high, and a perfect match is 0 as Bradski 
and Kaehler indicates. 

D. Find the matching image: 

With having the results of histograms comparisons, we 
compared between these results to find the least one of 
them,which represents the histogram of matching image, 
identified this image and print it out as indication of image 
matching.(Figure 3) depicts the implementation step by step. 


Figure 3. Flow chart of the project 
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Figure : Learnt and Tested Images 
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E. Code used 

import cva 
import numpy as np 
import 05 

from os.path import join,isfile 
ca p=cv2 video ca pt u re(-i) 

l_r snp.arrayflo.ioo.iooB #red 
u_r =np.arratf[l0,255,255l #red 
l_o =np.arratf[ll,100,100l #orange 
u_o =np.arrai<[20,255,2551 #o range 
l_b=np.arrav([ioo, loo, 1001 #blue 
u_b=np.array([l40,255,255J #blue 
kernel = np.ones((5,5),np.uintS) 
while True: 
ret,img=cap.read0 
blur=cv2.GaussianEluf(img,(7,7),o) 
cv2.im5hov< , gau55ian l ,blur) 
h5V=CV2.CVtColor(blur,CV2.COLOR_BGR2HSV) 
m a 5 kl=cv2. i n R a n ge(h s v, l_r, u_r) 

min_red2=np.array([i60,100,1001 
max_red2=np.arrayC[l79,255,255D 

mask2=cv2.inRange(hsv,min_red2,max_red2) 
ma5k=maskl+mask2 

kernel=cv2.get st ructuringElement(cv2.M0RPH_ELUPSE,(15,15)) 
mask_closed=cv2.morphologyE5<ma5k,cv2.MORPH_CLOSE, kernel) 
ma5k_clean=cv2.morphologyE^ma5k_clo5ed,cv2.MORPH_OPEH, kernel) 

^.imshowfmasMean^mask^lean) 

#cv2.imshov^mask_clo5ed l ,ma5k_closed) noise present in the output 

#re5=cv2.bitwise_and(ma5k_clean,ma5k_clean,mask=ma5k) 

#gray=cv2.cvtcolor(mask_clean,cv2.coLOR_BGR2GRAY) 

#ret, thresh = cv2.threshold(gray, 50, 255, 2) 
im2,contours,hierarchy = 

CV2 .f i n d CO nt 0 u rs(m a s k_cl e a n, CV2 . R ETR_EXTE R N AL, CV2 . CH Al N_AP P R OX_S IM P LE) 
if len(contours>0: 
fore in contours: 

epsilon = 0.0i*cv2.arcLength(c/rrue) 


V. CONCLUSION 

This project was based on color and size through comparing 
image histograms to find the best matching image.Our 
experimental results proved that this application shows 
accuracy with 75% of identifying fruits, (Figure4) shows 
samples of learnt images and tested images.In order to 
improve and enhance this application, there are some future 
work should be implemented, providing a user friendly 
interface, and expanding the range of fruits known by the 
application will increase performance of the application. 
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